Extraction of Non Manual Features for Videobased Sign Language Recognition

نویسندگان

  • Ulrich Canzler
  • Thomas Dziurzyk
چکیده

Videobased sign language recognition is barely investigated in the field of image processing. General conditions like realtime-ability and userand environmentindependence require compromise solutions. This paper presents a system for automatic analyzing of the facial actions. For this point distribution models and active shape models are brought into action. Additional a comparison is made between different approaches for the shapes initialization. Thomas ~ z i u r z ~ k ~ Chair for Technical Computer Science Aachen University Of Technology Existing sign language recognition systems rely exclusively on the manual parameters [I] [2] [3] although image processing offers the possibility to consider non-manual parameters, too. This work presents a coarse overview of a system in development for the automated analysis of the human mimic. The extraction of eyeand lip features using a biomechanical model is described in detail.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Classifying Non-manual Markers in American Sign Language

Facial expressions and other non-manual markers are the primary means by which American Sign Language (ASL) users signal sentence and clause type, negation, and a variety of adverbs. Work in the area of non-manual marker recognition has the potential to make ASL-toEnglish translation available in contexts where interpreters and human relay services are currently rare, such as events with non-si...

متن کامل

Sign Language Recognition System to aid Deaf-dumb People Using PCA

The Sign Language is a method of communication for deaf-dumb people. Here vision based approach has been used. This paper presents design and implementation of real time Sign Language Recognition system to recognize 26 gestures from the Indian Sign Language using MATLAB .The signs are captured by using web cam. This signs are preprocessed for feature extraction using HSV color model. The obtain...

متن کامل

Automatic Recognition of Auslan Finger-spelling using Hidden Markov Models

In recent years, gesture recognition has received much attention from research communities. Computer vision-based gesture recognition has many potential applications in the area of human-computer interaction as well as sign language recognition. Sign languages use a combination of hand shapes, motion and locations as well as facial expressions. Finger-spelling is a manual representation of alph...

متن کامل

A Belief-Based Sequential Fusion Approach for Fusing Manual and Non-Manual Signs

Most of the research on sign language recognition concentrates on recognizing only manual signs (hand gestures and shapes), discarding a very important component: the non-manual signs (facial expressions and head/shoulder motion). We address the recognition of signs with both manual and non-manual components using a sequential belief-based fusion technique. The manual components, which carry in...

متن کامل

Vision Based Hand Gesture Recognition Using Fourier Descriptor for Indian Sign Language

Indian Sign Language (ISL) interpretation is the major research work going on to aid Indian deaf and dumb people. Considering the limitation of glove/sensor based approach, vision based approach was considered for ISL interpretation system. Among different human modalities, hand is the primarily used modality to any sign language interpretation system so, hand gesture was used for recognition o...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2002